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Abstract 

Recently,  Ye  et  al.  [16]  demonstrated  that  Mizuno-Todd-Ye’s  predictor-corrector 
interior-point  algorithm  for  linear  programming  maintains  the  0(A/n.L)-iteration  com¬ 
plexity  while  exhibiting  superlinear  convergence  of  the  duality  gap  to  zero  under  the 
assumption  that  the  iteration  sequence  converges,  and  quadratic  convergence  of  the 
duality  gap  to  zero  under  the  assumption  of  nondegeneracy.  In  this  paper  we  establish 
the  quadratic  convergence  result  without  any  assumption  concerning  the  convergence 
of  the  iteration  sequence  or  nondegeneracy.  This  surprising  result,  to  our  knowledge, 
is  the  first  instance  of  a  demonstration  of  polynomiality  and  superlinear  (or  quadratic) 
convergence  for  an  interior-point  algorithm  which  does  not  assume  the  convergence 
of  the  iteration  sequence  or  nondegeneracy. 


Key  words:  Linear  programming,  primal  and  dual,  superlinear  and  quadratic  con¬ 
vergence,  polynomiality 

Abbreviated  title:  A  quadratically  convergent  0(\/nL)  algorithm  for  LP 


*  Department  of  Management  Sciences,  The  University  of  Iowa,  Iowa  City,  Iowa, 
52242.  This  author  was  supported  in  part  by  NSF  Grant  DDM-8922636,  the  Iowa 
Business  School  Summer  Grant,  and  the  Interdisciplinary  Research  Grant  of  the  Uni¬ 
versity  of  Iowa  Center  for  Advanced  Studies. 

**  Faculty  of  Technical  Mathematics  and  Informatics,  Delft  University  of  Technol¬ 
ogy,  Delft,  The  Netherlands. 

f  Department  of  Mathematical  Sciences  and  Center  for  Research  in  Parallel  Com¬ 
putation,  Rice  University,  Houston,  Texas,  77251-1892.  This  author  was  supported 
in  part  by  NSF  Coop.  Agr.  No.  CCR-8809615,  AFOSR  89-0363,  DOE  DEFG05- 
86ER25017  and  ARO  9DAAL03-90-G-0093. 

+  Department  of  Mathematics  and  Statistics,  University  of  Maryland  Baltimore 
County,  Baltimore,  MD  21228.  This  author  was  supported  in  part  by  NSF  Grant 
DMS-9102761  and  DOE  Grant  DE-FG05-91ER25100. 


1.  Introduction 


Consider  the  primal  linear  program  (LP): 


T 

mm  c  x 

s.t.  Ax  =  b,  x  >  0, 


and  its  dual  (LD): 

max  bT y 

s.t.  ATy  +  s  =  c,  s  >  0, 

where  A  £  RmXn,  c  £  R",  and  b  £  Rm.  We  say  that  s  is  feasible  for  (LD)  if  there 
exists  y  such  that  (y,s)  is  feasible  for  (LD).  A  feasible  point  is  said  to  be  strictly 
feasible  if  it  is  feasible  and  positive.  We  say  that  (x,s)  is  a  (strictly)  feasible  pair  for 
(LP)  and  (LD)  if  x  is  (strictly)  feasible  for  (LP)  and  s  is  (strictly)  feasible  for  (LD). 
It  is  well-known  that  for  a  feasible  pair  (x,s)  the  duality  gap  is  given  by  xTs.  Hence 
a  feasible  pair  (x*,s*)  is  optimal  if  and  only  if 


x*js*  =  0  for  j  =  l,2,...,n. 


Moreover,  consider  a  sequence  of  strictly  feasible  pairs  {(xk,sk)}  such  that  the 
duality  gap  sequence  ( xk)Tsk  — *  0.  Then  we  say  that  this  duality  gap  sequence 
converges  Q-superlinearly  to  zero  if 


lim 

k — i-oo 


(xk+1)Tsk+1 

( Xk)TSk 


=  0, 


and  Q-quadratically  to  zero  if 


rxk+i\Tsk+i 

h“8<£p~o (W<+°°' 

In  the  context  of  the  present  work  it  is  important  to  emphasize  that  the  notions  of 
convergence,  superlinear  convergence,  or  quadratic  convergence  of  the  duality  gap 
sequence  in  no  way  require  the  convergence  of  the  iteration  sequence  {(xfc,sfc)}.  Of 
course,  from  Hoffman’s  lemma  [4]  it  follows  that  in  a  particular  sense  the  iteration 
sequence  converges  to  the  optimal  solution  set  with  the  corresponding  R-rate. 
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Recently,  there  has  been  an  exciting  outbreak  of  activity  in  the  area  of  construct¬ 
ing  primal-dual  interior-point  algorithms  for  either  the  linear  programming  problem 
(LP),  or  the  (monotone)  linear  complementarity  problem  (LCP)  with  a  strict  comple¬ 
mentarity  solution,  that  are  demonstrably  superlinearly  or  quadratically  convergent. 
For  LP,  these  works  include  Zhang  et  al.  [17],  [18],  Ye  et  al.  [16]  and  McShane  [9]. 
For  LCP,  these  works  include  Kojima  et  al.  [6] [7],  Zhang  et  al.  [19],  and  Ji  et  al.  [5]. 

For  the  moment  assume  that  the  iteration  sequence  {(a;*,  s*)}  has  been  generated 
by  an  interior-point  algorithm.  Consider  the  following  assumptions: 

AO  a  strictly  feasible  pair  (a:°,s°)  exists; 

Al  the  iteration  sequence  {(xk,sk)}  converges; 

A2  the  linear  program  is  nondegenerate. 

We  intend  AO  and  Al  to  apply  to  both  LP  and  LCP.  It  is  known  that  A2  implies  Al 
when  the  duality  gap  converges  to  zero.  Note  that  AO  is  assumed  by  all  of  the  existing 
primal-dual  interior-point  algorithms.  Concerning  the  results  mentioned  above,  all  of 
the  superlinear  convergence  results  assumed  Al;  while  all  of  the  quadratic  convergence 
results  assumed  A2.  Perhaps  the  most  striking  theoretical  results  obtained  so  far  can 
be  cataloged  as  follows: 

-  Quadratic  convergence  for  the  LCP  that  possesses  a  unique  and  strict  comple¬ 
mentarity  solution  (Kojima  et  al.  [7]). 

-  O(nL)  iteration  complexity  and  superlinear  convergence  assuming  Al  (Zhang  and 
Tapia  [17]  for  LP  and  Ji  et  al.  [5]  for  LCP)  or  quadratic  convergence  assuming 
A2  (Zhang  and  Tapia  [17]  for  LP). 

-  O(yfnL)  iteration  complexity  and  superlinear  convergence  assuming  Al  (Ye  et 
al.  [16]  and  McShane  [9]  for  LP)  or  quadratic  convergence  assuming  A2  (Ye  et 
al.  [16]  for  LP). 

In  these  bounds  L  represents  the  data  length  of  the  problem  being  solved. 

Certainly,  the  global  property  of  polynomiality  and  the  local  property  of  super¬ 
linearity  are  desirable.  However,  the  degree  to  which  Al  is  restrictive  is  an  open 


3 


question  at  this  time.  Moreover,  A2  is  not  at  all  realistic,  since  most  real-world  LP 
problems  are  degenerate. 

In  what  follows  we  consider  the  Mizuno-Todd-Ye  predictor-corrector  algorithm 
analyzed  by  Ye  et  al.  [16].  We  show  that  this  0(-\/nX)  iteration  complexity  algorithm 
actually  gives  quadratic  convergence  of  the  duality  gap  to  zero  without  assuming 
either  Al  or  A2.  (Of  course  we  must  assume  AO  as  usual.) 

In  Section  2  we  review  the  algorithm  and  collect  several  previously  established 
estimates.  Section  3  contains  several  technical  results.  Our  main  convergence  result 
is  given  in  Section  4,  and  a  summary  and  concluding  remarks  are  contained  in  Section 
5. 


2.  The  Predictor-Corrector  Algorithm 

In  this  section,  we  briefly  describe  the  predictor-corrector  LP  algorithm  of  Mizuno  et 
al.  [11].  We  employ  the  notation  X  —  diag(:r),  S  —  diag(s),  etc.  and  let  ft  denote 
the  collection  of  all  feasible  pairs  (x,s).  Consider  the  set 

Af(a)  =  {(x,s)  €  ft  :  ||Ys  —  /xe||  <  a/i  and  [i  =  xTs/n}, 

where  ||.||  represents  the  I2  norm,  e  is  the  vector  of  all  ones,  and  a  is  a  constant 
between  0  and  1. 

To  begin  with  choose  a  constant  0<  /3  <  1/4  (a  typical  choice  would  be  1/4). 
All  search  directions  dx,  ds ,  and  dy  will  be  defined  as  solutions  of  the  following  system 
of  linear  equations  (Kojima  et  al.  [8]) 

Xds  +  Sdx  =  7  fie  —  Xs 

Adx  =  0  (1) 

A  dy  T  d3  =  0 

for  some  (a;,s)  £  ft,  where  n  =  xTs/n.  A  typical  iteration  of  the  algorithm  proceeds 
as  follows.  Given  ( xk,sk )  £  Af(/3),  we  solve  the  system  (1)  with  ( x,s )  =  ( xk,sk )  and 
7  =  0.  Denote  the  resulting  directions  by  dx  and  d*.  For  some  step  length  8  >  0  let 

x(6)  =xk+  8dkx,  s(8)  =  sk  +  8dka, 
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and  n(0)  =  x(0)T s(0)/n.  This  is  the  predictor  step.  The  specific  choice  for  0  will  be 
stated  after  we  consider  the  following  lemma  that  is  essentially  due  to  Mizuno  et  al. 
[111- 

Lemma  2.1.  Let  a  be  a  constant  between  0  and  1.  If  there  exists  a  positive  0k  <  1 
such  that 

||Y(0)s(0)  -  n{9)e\\  <  afi(0)  for  all  0  <  0  <  0k ,  (2) 


then  ( x(0k),s(0k ))  £  A/*(a). 

The  proof  of  Lemma  2.1  follows  directly  from  a  continuity  argument.  Lemma 
2.1  basically  says  that  the  feasibility  of  (x(0k),s(0k))  is  guaranteed  as  long  as  (2)  is 
satisfied.  Thus,  we  can  choose  the  largest  step  length  0k  <  1  such  that  (2)  is  satisfied 
for  a  =  2/3,  and  let 

xk  =  x{0k )  and  sk=s(0k). 


(Note  that  if  0k  =  1,  then  we  obtain  an  optimal  pair  in  a  finite  number  of  iterations.) 

Now  we  solve  the  system  (1)  with  (x,s)  =  ( xk,sk )  £  Af(2(3),  /c  =  ( xk)Tsk/n , 
and  7  =  1.  Let  xk+1  =  x k  +  dx  and  sfe+1  =  sk  +  ds.  It  has  been  proved  that 
(a;fc+1,sfe+1)  £  J\f(/3)  (Lemma  3  [11]).  This  is  the  corrector  step. 

We  are  now  in  a  position  to  state  the  algorithm. 

Large  Step  Predictor-Corrector  Algorithm  (Mizuno- Todd- Ye) 

By  the  large  step  predictor-corrector  algorithm  we  mean  the  algorithm  defined 
above  with  the  step  length  given  by  the  largest  0k  satisfying  the  conditions  of  Lemma 
2.1  with  0  <  f3  <  1/4  and  a  =  2/3. 


The  choice  of  0k  in  the  algorithm  requires  one  to  find  the  roots  of  a  quartic 
polynomial.  From  the  proof  of  our  main  result  we  will  see  that  the  choice  for  0k  need 
not  be  this  involved  and  it  suffices  to  choose  0k  as  the  lower  bound  given  in  Lemma 
2.2  below,  as  was  the  case  in  Ye  et  al.  [16].  These  comments  will  be  stated  formally 
as  a  corollary  to  our  main  theorem. 

Observe  that  the  algorithm  generates  a  sequence  of  feasible  pairs  satisfying 


11-xV  -  All  <  /?/ 


(3.1) 
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and 


(3.2) 


(xk+1)Tsk+1  =  (xk)Tsk  =  (1  -  6k)(xkfsk. 

For  convenience,  in  what  follows  let 

6“  =  Dkdk/[ik. 

/.From  Mizuno  et  al.  [11]  (Lemmas  1,  2,  and  4)  we  have  that 

|l«‘ll  <  V^n/4,  (4.1) 

and  for  0  <  /?  <  1/4 

>mm{-,(^p^)1/2}.  (4.2) 

Thus,  these  inequalities  together  with  (3.2)  imply  that  the  iteration  complexity  of  the 
large  step  predictor-corrector  algorithm  is  0(-v/nX).  Note  that  the  algorithm  requires 
that  the  linear  system  (1)  be  solved  twice  at  each  iteration. 

^From  relation  (3.2),  we  see  that  if  (1  —  ^fc)  — >■  0  then  the  duality  gap  ( xk)Tsk 
converges  to  zero  Q-superlinearly.  Moreover,  if  (1  —  6k)  =  0((xk)r sk)  then  the  duality 
gap  converges  to  zero  Q-quadratically.  In  our  convergence-rate  analysis,  as  opposed 
to  our  complexity  analysis,  the  big  O  notation  represents  a  quantity  that  may  or 
may  not  depend  on  n  or  L,  the  problem  data,  however  this  dependence  will  not  be 
explicitly  stated.  The  above  lower  bound  in  (4.2)  for  0k ,  due  to  Mizuno  et  al.,  is  not 
sufficient  to  demonstrate  superlinear  convergence  since  it  is  at  most  1/2.  Thus,  Ye  et 
al.  [16]  derived  the  following  lower  bound  for  6k . 

Lemma  2.2.  If  6k  is  the  largest  6k  satisfying  the  conditions  of  Lemma  2.1  with 
a  —  2/?,  then 

ek  >  2  — — . 

V,l+4||«*||/0  +  l 

Using  the  bound  given  in  Lemma  2.2,  Ye  et  al.  [16]  have  proved  that  the  large  step 
predictor-corrector  algorithm  maintains  the  0(^/nL )  iteration  complexity,  and  also 
gives  superlinear  convergence  under  assumption  Al  or  quadratic  convergence  under 
assumption  A2.  In  the  next  section  we  will  show  how  to  remove  these  assumptions 
and  actually  obtain  quadratic  convergence  for  general  LP  problems. 
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3.  Technical  Results 


At  the  A;th  predictor  step  if  6k  is  the  largest  6k  satisfying  the  conditions  of  Lemma 
2.1  with  a  =  2(3,  then 

1  -  9k  <  1  -  -  2  = - 

Vl +411^11/^  +  1 

0+411^11/^-1 
y/l+4\\6k\\/f3  +  l 

4 mu 

(71+411^11//? +  1)2 

<  \\6km  (5) 

Our  goal  is  to  prove  that  ||£fc||  =  0((xk)T sk)  without  using  assumption  Al  or  A2. 

We  first  introduce  several  technical  lemmas.  For  simplicity,  we  drop  the  index  k 
and  recall  the  linear  system  during  the  predictor  step 


Xds  +  Sdx  =  —  Xs 

Adx  =  0  (6) 

A? dy  +  ds  =  0. 

Let  fi  —  xTs/n  and  z  =  Xs.  Then  from  (3.1)  we  must  have 

(1  ~P)H  <  Zj  <  (1  +P)l*  for  3  =  1,2,  (7) 

Define  D  =  X1/2  S-1/2  and  denote  by  IIl  the  orthogonal  projection  onto  the  linear 
subspace  L  of  Rn.  Denote  by  N(AD )  and  R(DAT )  the  null  space  of  AD  and  the 
range  of  DAT ,  respectively.  We  shall  estimate  ||dx||  and  ||d3||.  Our  objective  in  this 
section  is  to  demonstrate  that  ||dx||  =  0(/j.)  and  ||ds||  =  O(fi). 

We  start  by  characterizing  the  solution  to  (6). 

Lemma  3.1.  If  dx  and  ds  are  obtained  from  the  linear  system  (6),  then 

dx  =  —  -DII;v(ylD)D 
ds  =  -D~1UR^DAT)r, 
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where  r  =  Zl!2e. 

Proof.  The  proof  is  straightforward,  e.g.,  see  Adler  and  Monteiro  [1].  I 

It  is  well  known  that  for  every  linear  program,  a  unique  partition  A  =  (£,  N ) 
exists  such  that  the  primal  optimal  face  is  given  by 

VLp  =  {x  =  ( xb,xn )  :  Bxb  =  b,  xb  >  0,  xn  =  0} 

and  the  dual  optimal  face  is  given  by 

fid  —  {(y,  =  (y,  (sbi  SN ))  :  sB  =  cB  -  BTy  =  0,  sn  =  cN  -  NTy  >  0}. 

Strictly  feasible  solutions  xb  >  0  and  sn  >  0  exist  on  these  optimal  faces,  respectively, 
and  both  faces  are  bounded  under  assumption  AO.  Here,  we  also  use  B  and  N  to 
denote  the  partitioned  column  index  sets.  For  all  k ,  relation  (3.1)  implies  that 

£  <  x)  <  1  ft  for  j  e  B  (8.1) 

and 

t<skj<l/t  ^  J  €  N,  (8.2) 

where  ^  <  1  is  a  fixed  positive  number  that  is  independent  of  k  (Giiler  and  Ye  [3]). 
Lemma  3.2.  If  dx  and  ds  are  obtained  from  the  linear  system  (6)  and  y,  =  xTs/n, 
then 

||(d*)w||  =  O(fji)  and  ||  (g?s)b  ||  =  0(n). 

Proof.  From  Lemma  3.1,  we  obtain 

\\D~ldx\\  <  ||nWMD)||||r|| 

<  ||r||  =  0{yfjl). 

We  have  from  relations  (7)  and  (8) 

\\(dx)N\\  =  WDND^id^NW 

<  ||L>jv||||L>w1(d,)iv|| 

<  \\Dn\\0(^JI) 

=  \\z]l2S^\\0{y/]l) 

=  0(^)0^)  =  o(n). 
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This  proves  that  ||(<iI:)jv||  =  0(/x).  The  proof  that  ||(ds)B||  =  O(fi)  is  similar.  I 

The  proofs  of  ||(dI)B||  =  0(/i )  and  ||(ds)jv||  =  0(/i)  are  more  involved.  Towards 
this  end,  we  first  note 

x  +  dx  =  DURmAT)r , 

0) 

s  -\-  ds  —  D  niV(v4£))r. 

This  is  because  from  the  first  equation  of  (6)  we  have 

S(  x  +  dx)  =  —Xds 
X"(s  -f-  dg'j  —  — Sdx. 

Thus, 

x  +  dx  =  —(XS~1)da  =  -D2ds 
s  +  d3  =  -(SX-1)^  =  —D~2dx, 

which  gives  relation  (9). 

The  following  lemma  is  essentially  due  to  Adler  and  Monteiro  [1]  (also  see  Son- 
nevend  et  al.  [12]  and  Witzgall  et  al.  [14]). 

Lemma  3.3.  If  dx  and  ds  are  obtained  from  the  linear  system  (6),  then  (dx)R  is 
the  solution  to  the  (weighted)  least-squares  problem 

min  (l/2)||D5>u||2 

u 

s.t.  Bu  —  — N(dx)N , 


(10.1) 


and  ( ds)N  =  -NTdy  where  dy  is  a  solution  to  the  (weighted)  least-squares  problem 

min  (l/2)||DiviVTu||2 

V 

s.t.  Btv  =  -( d$)s . 


(10.2) 


Proof.  From  (9),  we  see  that 


XB  +  (dx)B  €  R(D2bBT). 

Since  s*B  =  0  for  all  optimal  s*,  we  must  have  cb  G  R(Bt).  Thus, 


(11) 


$B  =  CB  ~  BTy  €  R(Bt), 
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which  implies  that 


xb  —  D2bsb  £  R(DbB  ). 


(12) 


^.From  (11)  and  (12)  we  have 

(4)b  €  R(D2bBt). 

Moreover,  ( dx)B  satisfies  the  equation 

B(dx)B  =  —N(dx)N. 

Thus,  ( dx)B  satisfies  the  Karush-Kuhn- Tucker  conditions  for  the  least  squares  problem 

(10.1). 

Since  AD2(s  +  ds )  =  —  Adx  =  0  and  AD2s  =  Ax  =  b,  it  follows  that 

-b  =  AD2ds  =  BD2B(ds)B  +  ND2N(ds)N.  (13) 

Also,  since  x*N  =  0  for  all  optimal  x*,  we  have  Bx*b  =  b  implying  b  G  R(B).  Therefore, 
relation  (13)  implies 

ND2NNTdy  =  -ND2N(d3)N  G  R(B). 

Moreover,  dy  satisfies  the  equation 

BT dy  =  —(ds)B- 

Thus,  dy  satisfies  the  Karush-Kuhn- Tucker  conditions  for  the  least  squares  problem 

(10.2).  I 

Theorem  3.1.  If  dx  and  ds  are  obtained  from  the  linear  system  (6)  and  /r  =  xTs/n, 
then 

||(<4)b||  =  O(n)  and  ||(ds)jv||  =  O(^). 

Proof.  Since  the  least-squares  problem  (10.1)  is  always  feasible,  there  must  be  a 
feasible  u  such  that 

INI  =  o(\\(dx)N\\), 


10 


which  together  with  Lemma  3.2  implies 


INI  = 

Furthermore,  from  Lemma  3.3  and  relations  (7)  and  (8) 

IK4)b||  =  II  DBD-Bl(dx)B\\ 

<\\DB\\\\D-B\dx)B\\ 

<  WDbMd^uW 

^WDbMd^wm 

=  ||z-1/2Xb||||4/2^b1IIII^II 
<II^b1/2IIII^bIIII4/2IIII^b1IIII^II 
=  0(||«||)  =  Ofo). 

Similarly,  we  can  prove  the  second  statement  of  the  theorem.  I 

4.  Quadratic  Convergence  without  Assumption  A1  or  A2 

Lemma  3.2  and  Theorem  3.1  indicate  that  at  the  A:th  predictor  step,  d k  and  dks  satisfy 

IMill=  0(Z)  and  ||dj||=0(/),  (14) 

where  fik  =  (xk)Tsk /n,  for  all  k  >  0.  We  are  now  in  a  position  to  state  our  main 
result. 

Theorem  4.1.  Let  {(xk ,sk)}  be  the  sequence  generated  by  the  large  step  predictor- 
corrector  algorithm.  Then,  with  constants  0  <  /?  <  1/4  and  a  =  2/3, 

(i)  the  algorithm  has  iteration  complexity  0(^/nL); 

(ii)  1  —  9k  =  0((xk)Tsk)-,  and 

(iii)  ( xk)Tsk  — »•  0  Q-quadratically. 

Proof.  The  proof  of  (i),  i.e.,  the  0(y/nL)- iteration  complexity  of  the  algorithm  follows 
from  inequalities  (3.2),  (4.1)  and  Lemma  2.2,  which  give 

(. xk+1)Tsk+1  <  (1 -  2 . — - )(xk)Tsk. 

y  1  +  '/2n/ f3  +  1 
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This  also  establishes 


lim  ( xk)Tsk  =  0. 

k— >oo 

,i,From  relation  (14)  we  have 

||«*||  =  l|Dj<$//ll  <  ll<£llll<tfll/f*  =  0((/)2)//  =  0(/)  =  0((**)V), 

which  together  with  (5)  establishes  (ii).  ^From  (3.2)  we  see  that  (ii)  implies  (iii).  This 
proves  the  theorem.  I 

The  asymptotic  behavior  of  (Xk)~1dk  and  (Sk)~1dk  at  the  predictor  step  seems 
interesting.  Using  relations  (8)  and  (14),  we  have 

|(^);/x‘|  =  0(/)  for  j  e  B  (15.1) 

and 

M,‘W4l  =  °(/)  for  i€N-  (15-2) 

Moreover,  at  the  predictor  step  (i.e.,  7  =  0),  it  follows  from  system  (1)  that 

+  ^  =  -1  (16) 
SJ 

for  every  j  =  1,2,  ...,n.  Thus,  relations  (15)  and  (16)  imply  that 

lim  ^x)j.  =  0  and  lim  —  ~  1  for  j  €  B 

fc— +  00  Xj  k— >00  Sj 

and 

lim  =  —  1  and  lim  -  *)?■  =  0  for  j  6  N. 

k—>  00  Xj  k — >oo  5* 

Interestingly,  the  behavior  of  ( Xk)~1dk  and  ( Sk)~1dk  was  discussed  by  Tapia  [13] 
in  (1980)  for  complementarity  problems  where  the  strict  complementarity  solution  is 
unique.  He  used  these  two  vectors  as  the  basis  of  an  indicator  theory  for  identifying 
variables  which  are  zero  at  the  solution.  See  also  El-Bakry  et  al.  [2].  These  two  vectors 
were  also  used  by  Mehrotra  and  Ye  [10]  as  a  criterion  for  identifying  the  partition  B 
and  N. 


(4h 

rjt  k 

Xj 
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The  following  corollary  formally  states  that  we  do  not  need  to  choose  the  largest 
step  in  the  predictor  step,  but  only  a  sufficiently  large  step.  Thus,  we  are  no  longer 
required  to  find  the  zeros  of  a  quartic  polynomial. 

Corollary  4.1.  If  the  predictor-corrector  algorithm  is  adapted  with  6k  given  by  the 
lower  bound  in  Lemma  2.2,  then  Theorem  4.1  also  holds  for  the  modified  algorithm. 

5.  Summary  and  Concluding  Remarks 

Recently,  Mizuno  et  al.  [11]  proposed  a  large  step  predictor-corrector  interior-point 
algorithm  for  linear  programming.  They  demonstrated  that  the  algorithm  possessed 
0(\/nL)  iteration  complexity.  More  recently,  Ye  et  al.  [16]  proved  that  the  algorithm, 
while  maintaining  0(y/nL )  iteration  complexity,  exhibited  superlinear  convergence  of 
the  duality  gap  sequence  to  zero  under  the  assumption  that  the  iteration  sequence 
converged,  and  exhibited  quadratic  convergence  of  the  duality  gap  sequence  to  zero 
under  the  assumption  of  nondegeneracy.  In  this  paper  we  have  established  the  surpris¬ 
ing  result  that  the  large-step  predictor-corrector  algorithm  actually  exhibits  quadratic 
convergence  of  the  duality  gap  to  zero  without  the  assumption  of  nondegeneracy  or 
even  the  assumption  that  the  iteration  sequence  converges.  This  result  is  the  first  in¬ 
stance  of  a  demonstration  of  polynomiality  and  superlinear  (or  quadratic)  convergence 
for  an  interior-point  method  which  does  not  assume  the  convergence  of  the  iteration 
sequence  or  nondegeneracy.  We  note  that  each  iteration  in  the  predictor-corrector 
algorithm  requires  the  solutions  of  two  linear  systems — one  in  the  predictor  step  and 
one  in  the  corrector  step. 

Although  the  iteration  sequence  {(x*,sfc)}  may  not  be  convergent,  it  is  a  conse¬ 
quence  of  Hoffman’s  lemma  [4]  that  the  sequence  {a:*’}  converges  jR-quadratically  to 
the  primal  optimal  set  The  same  is  true  for  the  sequence  {s*1'}  if  we  write  the 
dual  linear  program  and  its  optimal  solution  set  in  terms  of  s  alone. 

While  seemingly  quadratic  convergence  has  often  been  observed  in  practice  for 
primal- dual  interior-point  methods  applied  to  degenerate  problems,  its  effectiveness 
is  compromised  by  the  use  of  finite-precision  arithmetic  to  solve  the  necessarily  ill- 
conditioned  linear  systems.  Hence  our  current  result  may  have  only  theoretical  value. 
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In  this  context  the  finite  termination  procedures  of  Ye  [15]  and  Mehrotra  and  Ye  [10] 
are  of  value  in  obtaining  an  optimal  solution. 

It  has  been  observed  in  practice  that  the  0{y/nL )  algorithms  that  have  been 
tested  so  far  are  generally  less  effective  than  are  some  of  the  O(nL)  algorithms  (or 
other  non-polynomial  algorithms).  Zhang,  Tapia  and  Dennis  [18]  argued  that  sev¬ 
eral  of  these  0(\/nL)  algorithms  possess  particularly  poor  Q-convergence  properties, 
i.e.,  they  exhibit  Q-linear  convergence  with  convergence  constants  near  1  for  large 
n.  Therefore,  some  researchers  may  have  embraced  the  belief  that  the  0(^/nL)  algo¬ 
rithms  were  less  effective  because  none  of  them  could  achieve  superlinear  convergence. 
Now,  we  have  demonstrated  that  a  particular  0(\/nL)  algorithm  actually  has  what 
we  consider  to  be  the  optimal  convergence  rate  for  degenerate  or  nondegenerate  prob¬ 
lems.  If,  perchance,  numerical  experimentation  still  favors  the  0(nL )  algorithms, 
then  we  must  conclude  that  their  advantage  is  not  due  to  their  asymptotic  behavior, 
but  to  some  other,  as  yet  unexplained,  phenomenon. 
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